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Why  bother  to  sell  ROBOTS 
when  you  can  sell  robot  STOCK? 


Denning  Mobile  Robotics  has  yet  to  build  a 
robot.  Why  bother,  when  shareholders  seem 
mesmerized  by  its  power  of  suggestion? 


Beep,  beep . . . 
buy  this  stock 


'~n-. 


n 


^ ^ f  _ to  4  — _ 

By  John  A.  Byrne 

T|  HE  IDEA  IS  PURE  Star  WOTS:  Scll 
sinisteT'looking  robots  to  guard 
prisons  and  industrial  boilings. 
Denning  Mobile  Robotics,  Inc.  went 
public  with  this  concept  last  summer, 
and  investors  gobbled  up  the  penny 
stock  offering.  They  paid  S3  million 
for  one-third  of  the  company. 

In  January  the  Wall  Street  Journal 
and  other  publications  reponed  that 
Denning  had  landed  a  S30  million 
contract  to  supply  robots  to  Southern 
Steel  Co.  Share  prices  zoomed.  A  Dcn- 


ning  umt  (comprising  one  share  of 
common  and  two  warrants  to  buy 
more  stock  later)  now  sells  for  about 
59  cents,  quite  a  rise  from  the  10-ccnt 
offering  price.  Controversial  stock 
picker  Ray  Dirks  thinks  bigger  gain* 
arc  in  store.  "Denning  is  my  pick  for 
1984,"  he  proclaims. 

The  company's  spare  headquarters 
outside  Boston,  however,  is  anything 
but  glamorous.  Denning  operates  out 
of  a  shabby  industrial  building,  one 
flight  down  from  a  contract  bridge 
school.  Visitors  must  sign  secrecy 
agreements,  and  a  warning  reads  "£s¬ 


con  Required  Beyond  This  Point." 
That's  puzzling  b^use  there  are  no 
robots  inside,  just  some  things  chat 
look  like  garbage  cans  on  whe&. 

Enter  R.  Warren  George  II,  Den¬ 
ning's  intense  3  7-y ear-old  founder 
and  president.  He  e3cplains  that  he 
previously  worked  as  a  Washington 
lobbyist  for  Foster-Miller  Associates, 
a  small  machinery  designer.  He  left 
the  company  in  198 1,  he  says,  because 
he  wanted  to  get  into  a  high-technolo¬ 
gy  business.  A  Foster-Miller  spokes¬ 
man  remembers  things  differently. 
She  says  George  was  axed  in  a  staff 
reduction. 

Denning's  founder  has  other  back¬ 
ground  problems — which  he  admits 
when  confronted  by  Forbes  with  the 
facts.  George  has  led  colleagues  and 
investors  to  believe  he  holds  three 
degrees,  including  an  M.B.A.  from 
Babson  College  and  an  MTT  master's 
in  materials.  Neither  institution  has  a 
record  of  his  attendance.  What  about 
his  days  at  the  University  of  New 
Hampshire?  The  school  says  he  never 
graduated,  though  he  was  a  student 
for  six  years. 

Of  course,  it  doesn't  take  a  diploma 
to  run  a  business.  After  a  friend  sug¬ 
gested  that  he  look  into  robotics, 
George  wrote  a  proposal  and  made  a 
pitch  to  75  venture  capitalists.  No 
takers.  Denning  is  a  pioneer,  explains 


FORBES,  APRIL  23.  1984 

...  already  been  tried! 
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So  the  real  answer  is... 


•  We  aren’t  all  rich  because  nobody  Is  buying  a  lot 
of  smart  robots. 


•  Nobody  is  buying  a  lot  of  smart  robots  because 
a  robot  that  a  lot  of  people  would  want  to  buy 
would  have  to  be  useful  and/or  entertaining, 
inexpensive  enough  for  people  to  afford,  and  be 
perceived  to  be  worth  its  price.  Simply  being 
“smart”  doesn’t  matter. 


•  So  the  REAL  answer  is  actually  question:  “How 
can  we  build  smart  robots  that  are  (1)  useful 
and/or  entertaining,  (2)  inexpensive  enough  for 
peopie  to  afford,  (3)  perceived  to  be  worth  their 
price?” 
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Outline 


*The  SPAWAR  perspective  on  robotics 
•Polemicai  remarks 

-  A  cynic’s  view  of  robotics  research 

-  Lessons  from  MDARS-I 

-  Sensing,  perception,  and  navigation  in  humans  and  robots 

-  Lessons  from  the  Past?  ALV,  speech  recognition 

-  Limits  of  the  biomimetic  approach 

-  “Irreievant  Aigorithm  Syndrome” 

•Brief  Case  Study:  the  DARPA  Tacticai  Mobiie 
Robotics  (TMR)  Program 

•Need  both  tight  integration  and  maximum  fiexibiiity 
•Conciusion:  Economics  ruies  in  the  Next  Miiienium! 
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V  http  ://www.spawar.  navy .  m  i  I/robots/ 
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Space  and  Naval  Warfare  Systems  Center 
(formerly  NELC,  NUC,  NOSC,  NRaD) 

UUVs  since  early  1960s,  UGVs  since  eariy  1980s 
Prototype  system  deveiopment,  not  “basic  research” 
Many  technicai  papers  on  iine  at  above  URL 
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Robotics  Development  Process 
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(Effort  required  is  proportional  to  area) 

Development  of  brilliant  universal 
overarching  architectural 
scheme 


Application  of  scheme  to 
a  specific  robot  design 

Detailed  design 

Implementation 


Debugging  and 
demo  prep 


Bottom  line:  definitely  1%  inspiration,  99%  perspiration! 


SPAWAR  Systems  Center,  San  Diego 
San  Diego  CA  92152-7383 


The  Downside  Risk: 
A  Cynic’s  View 
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GOAL 


To  explore  the  possibilities  and  impiications  of  a  proposed 
innovative  behavior/controi/navigation  architecture/system 

APPROACH 

To  impiement  a  physicai  robot  to  serve  as  a  testbed  and 
demonstration  piatform 

WHAT  IS  LEARNED 

Alkaline  batteries  are  good 

Rechargeabie  batteries  work  best  when  actuaiiy  recharged 
Connectors  and  cabies  are  faiiure  prone 
Sensors  are  "unreiiabie" 

Whatever  monitoring  toois  were  impiemented  in  the  systems  aren’t 
good  enough  to  teii  what's  "broken"  when  “it  doesn't  work" 

A  cut-up  cardboard  box  can  keep  the  sun  off  a  monitor  screen 

You  never  have  enough  batteries  for  your  digitai  camera 
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Alan  Alda’s  comments  from 
“Natural  Born  Robots” 
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•  “...but  while  I  was  there  it  was  barely  able  to 
lurch  to  its  feet.” 

-  re  Case  Western  Reserve  giant  pneumatic  cockroach 

•  “And  so  a  sinking  robot  pike  joins  the  stubborn 
robot  cockroach  in  demonstrating  just  how  hard 
it  is  to  copy  mother  nature.” 

-  after  MIT’s  “Robo-pike”  deveioped  a  ieaky  “head-gasket” 

•  “I’m  beginning  to  wonder  if  I’m  some  sort  of 
robot  jinx.” 

-  after  a  motor  faiied  on  MIT’s  “Spring  Fiamingo” 

-  from  Scientific  American  Frontiers:  Naturai  Born  Robots 
(show  1002),  on  PBS,  2  November  1999 
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General  Lessons  Learned 
From  MDARS-I  (1) 
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Moving  a  robot  from  one  environment  to  another  invites 
unanticipated  probiems;  typicai  causes  inciude: 

•  hardware  and  software  errors  that  haven't  been 
manifested  in  the  previous  environment 

•  sensor  modes  or  processing  aigorithms  tuned  too 
tightiy  to  specific  characteristics  of  the  initiai 
deveiopment  environment 

•  unexpected  breakdowns  due  to  subtie  interactions 
between  muitipie  hardware  and  software  components 

A  weii  impiemented  adaptive  behavior  can  mask  fau its; 
shouid  instrument  behavior  to  report  a  probiem  such  as 
steering  that  constantiy  "puiis  ieft" 
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General  Lessons  Learned 
From  MDARS-I  (2) 
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If  a  complex  robot  is  to  operate  robustly,  its  worid  modei 
must  take  adequate  account  of  the  reievant  dimensions  of 
variabiiity  of  the  environment,  as  they  wiii  be  reported  by 
the  sensor  subsystems. 

•  A  robot's  worid  modei  is  much  simpier  than  a  human's 

•  Unintended  aspects  of  the  modei  can  creep  in  as 
consequences  of  various  software  design  decisions 

•  The  deveioper  must  understand  the  iimits  of  his 
system's  worid  modei 

Behaviorai  robustness  is  required  if  mobiie  robots  are  to 
find  viabie  markets;  the  designer  must  accommodate  the 
fuii  range  of  variabiiity  within: 

•  manufacturing  processes:  no  handcrafting 

•  target  operating  environments:  no  manuai  "tuning" 
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General  Lessons  Learned 
From  MDARS-I  (3) 
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Expect  the  unexpected! 


Human  Perception-based 
Navigational  Capabilities 

Systems  Center 
San  Diego 

Every  human  naturally  acquires  the  skills  to 

-  avoid  bumping  into  anything  while  moving 

-  understand  where  he  or  she  is  trying  to  go 

-  figure  out  how  to  get  there 

Humans  are  therefore  abie  to  accept  and  execute  tasking 
presented  in  terms  iike: 

"Go  down  this  road  about  a  mile  and  turn  left  on  Union  Street  --it's  the 
second  or  third  light,  I  think  --  and  then  turn  right  into  the  alley  just 
past  the  McDonald's;  it's  the  second  house  on  the  left,  the  green  one 
with  an  elm  tree  in  front  --  you  can't  miss  it." 

One  key  is  that  a  human  can  detect,  iocaiize,  ciassify,  and  identify 
specific  environmentai  features: 

-  under  widely  varying  environmental  conditions 

-  independent  of  relative  orientation  and  distance 

But  a  robot’s  perceptuai  capabiiities  are  extremeiy  iimited 

Sensing  is  NOT  necessarily  perceiving 
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The  Distinction  Between 
Sensing  and  Perception 


Robotics  researchers,  being  human,  are  so  compietely 
immersed  in  the  world  created  by  our  vision-oriented 
perception  capabilities  that  we  tend  to  mistake  it  for  the 
actual  physical  world  around  us,  and  are  therefore 
constantly  surprised  and  disappointed  by  the 
comparatively  pitiful  capabilities  of  our  robots' 
sensors. 


Practical  and  affordable  sensor  systems  simply  do  not 
provide  enough  accuracy  or  resolution  to  make  up  for  a 
robot's  lack  of  human-level  perceptual  processing. 
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To  the  inventor  of  the  hammer, 
everything  looks  like  a  nail... 


12 


DOD  Targets  3  Projects  For  AI,  Supercomputer  Uses 

^ _  j  a  in  novel  situations.  logical  goals  of  the  strategic 


By  Chappell  Brown 

BOSTON  —  Lynn  Conway,  as¬ 
sistant  director  of  strategic  com¬ 
puting  for  the  Department  of  De¬ 
fense,  outlined  a  broad-based 
program  here  last  week  to  apply 
artificial  intelligence  and  super¬ 
computer  technology  to  military 
systems. 

Congress  has  approved  $50 
million  in  funding  in  fiscal  1984 
for  an  initial  project  that  targets 
development  of  three  military  ar¬ 
tificial  intelligence  systems  by 
technology  and  applications 
“communities,”  Conway  said. 

Projects  Described 

Conway,  speaking  at  a  VLSI 
conference  at  the  Massachu¬ 
setts  Institute  of  Technology, 
said  the  systems  to  be  developed 
initially  include  an  autonomous 
land  vehicle,  a  personalized  ad¬ 
viser  for  jet  pilots  and  an  air¬ 
craft  battle-management  system. 

Though  Conway  did  not  go  into 
details  about  each  project,  in  the 
past  the  Defense  Department  has 


said  that  the  militaiy  would  like  a 
land  vehicle  that  could  roam  a 
battlefield  and  detect  enemy 
troops  or  equipment.  The  jet  pilot* s 
“adviser”  will  be  an  expert  system 
giving  instantaneous  advice  to  jet 
pilots  during  flight,  and  a  comput¬ 
erized  battle  management  system 
would  coordinate  attacks  from  an 
aircraft  carrier. 

Military  Appiications 

Conway  said  development  of 
these  systems  would  provide 
the  basis  of  a  “strategic  com¬ 
puting”  program  that  would 
develop  technology  of  “unprec¬ 
edented  capabilities.” 

The  program  will  focus  on 
military  applications  that  re¬ 
quire  machine  intelligence  and 
will  draw  on  recent  advances  in 
coihputer  vision,  speech,  and  ex¬ 
pert  system  technology. 

Expert  systems  are  a  branch 
of  artificial  intelligence  re¬ 
search  that  use  databases  de¬ 
rived  from  the  experience  of  hu¬ 
man  experts  to  draw  inferences 


in  novel  situations. 

Conway  used  an  incident  in 
the  Falklands  war  as  an  exam¬ 
ple,  illustrating  the  use  of  this 
kind  of  system  in  a  battle. 

Falklands  Incident  Cited 

British  ships  were  using  a 
computer-controlled  radar  sys¬ 
tem  as  a  defense  against  Argen¬ 
tine  aircraft.  Although  the  sys¬ 
tem  was  highly  advanced,  the 
Argentinian  pilots  found  a  ploy 
that  would  confuse  the  sys¬ 
tem — they  would  fly  in  a  tight 
pattern,  appearing  as  a  single 
object  to  the  radar,  and  then 
quickly  disperse. 

This  unexpected  maneuver 
confounded  the  computer-con¬ 
trolled  system.  The  experts 
needed  to  reprogram  the  system 
were  all  back  in  Britain. 

What  was  required  was  an  in¬ 
stantaneous  expert  at  the  scene, 
or,  even  better,  a  system  that 
was  more  adaptable  to  novel  sit¬ 
uations,  Conway  said. 

There  are  three  broad  techno¬ 


logical  goals  of  the  strate^c 
computing  program:  to  provide 
the  United  States  with  a  broad- 
based  machine  intelligence  ca¬ 
pability,  demonstrate  applica¬ 
tions  important  to  defense  and 
provide  technological  spinoffs. 

A  fundamental  theme  of  the 
project  will  be  the  interaction  of 
advanced  areas  of.  research.  For 
example,  advanced  VLSI  arohi- 
tectures  need  to  be  combined 
with  the  kind  of  software  and 
systems  work  being  undertaken 
by  artificial  intelligence  re¬ 
searchers.  At  this  time,  research 
groups  such  as  these  are  not  co¬ 
ordinated,  Conway  pointed  out. 

Applications  ‘Puir 

In  Conway’s  view,  specific 
programs — such  as  developing 
an  autonomous  land  vehicle — 
impel  this  kind  of  cooperation; 
she  spoke  of  applications  pro¬ 
viding  the  “pull”  needed  to  cre¬ 
ate  machine  intelligence. 

Although  DARPA  (Defense 
Advanced  Research  Projects 


Agency)  will  manage  the  project, 
approximatly  10  “computer  tech¬ 
nology  communities”  will  be  cre¬ 
ated  to  develop  the  required  tech¬ 
nology  and  another  five  to  10 
“applications  commimities”  will 
work  on  implementation.  Each 
community  will  involve  100 
professionals  from  private,  aca¬ 
demic  and  government  areas. 

A  high  degree  of  interactivity 
will  be  crucial  to  the  project,  and  | 
networks  and  interactive  work-  t 
stations  will  be  heavily  used.  " 
Conway  used  the  phrase  “an  on*, 
line  window  into  activities.”  ■ 

Although  the  need  for  secrecy 
on  defense  projects  might  work  ^ 
against  this  open  communii^  ^ 
tions  network,., Coni/^ay  repli«4^3® 
that  only  the<^pecific  applicaj 
tions  communities  would  Opr; 
erating  under  classified 
mation  restrictions.  The 
technology  development 
gram  would  be  open. 

The  plan  calls  for  $50  millii 
in  1984,  $96  million  in  198 
and  $150  in  1986 


Japanese  Reveal  VLSI  Thrusts  ^  WOUtRen^^  ^ 

Bv  ChaopeU  arp  still  laUrvr-of—-  uri-  [ 


-^’-h  are  still  laUrvr.of— -  uri- 


(announcement  of  DARPA  ALV  program,  January  1984) 
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Autonomous  Land  Vehicle  (ALV) 
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A  Lesson  from  ALV? 


*  Autonomous  Land  Vehicle  began  in  1984,  with 
goals  that  arguably  have  not  yet  been  realized 
1 5  years  later 

-  Not  from  want  of  trying:  Demo  II,  Demo  III,  others 

-  15  years  of  Moore’s  Law  progress:  factor  of  100  to  1000 

•  If  we  were  that  far  off  in  assessing  the 
difficulties  of  the  problem  in  1984,  what  makes 
us  think  that  we  are  any  smarter  today? 
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“Whither  Speech  Recognition?” 
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•  J.  R.  Pierce,  Bell  Labs,  Letter  to  the  Editor  of 
Journal  of  Acoustical  Society  of  America,  1969: 

-  “Most  recognizers  behave,  not  like  scientists,  but  like  mad 
inventors  or  untrustworthy  engineers.  The  typical 
recognizer  gets  it  into  his  head  that  he  can  solve  “the 
problem”.  The  basis  for  this  is  either  individual  inspiration 
(the  “mad  inventor”  source  of  knowledge)  or  acceptance  of 
untested  rules,  schemes,  or  information  (the  untrustworthy 
engineer  approach)... 

-  “The  typical  recognizer...  builds  or  programs  an  elaborate 
system  that  either  does  very  little  or  flops  in  an  obscure 
way.  A  lot  of  money  and  time  are  spent.  No  simple,  clear, 
sure  knowledge  is  gained.  The  work  has  been  an 
experience,  not  an  experiment.” 

-  JASA  Volume  46,  Number  4  (Part  2)  1969,  pp  1049-1051. 
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Biologically  Inspired  Systems 

Systems  Center 
San  Diego 

•  A  biological  system  is  evolved,  and  does  just  what 
it  does.  It  is  not  necessarily  the  “existence  proof” 
for  something  “similar”  that  would  be  “useful” 

-  Lacks  a  well  defined  “control  interface”  to  modulate  system 
goals 

-  Implemented  as  opportunistic  collection  of  special  cases 

-  Implementation  iayering  is  imperfect 

•  Implication:  opportunities  for  exploitation  of 
biological  approaches  have  well  defined  limits 

-  Effectiveness  and  efficiency:  automobiies  have  wheeis,  not 
iegs,  airpianes  don’t  fiap  their  wings  iike  birds 

-  Physicai  evoiution  generaiiy  too  expensive  in  terms  of  time 
and  resources 
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“Now  that’s  flying  first  ciass” 


(1990  advertisement  for  100%  Colombian  coffee) 
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Irrelevant  Algorithm  Syndrome 
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•Generally  manifested  as  simulation  (or  “toy” 
demo)  totally  decoupled  from  reality 

•Case  1 :  “Fantastical”  sensors 

-Group  foraging  algorithm  using  sensor  that  reliably  provides 
the  distance  and  direction  to  the  “nearest  food  item” 

-Formation  algorithm  using  sensor  that  reliably  provides  the 
distance  and  direction  to  the  farthest  member  of  the  group 

•Case  2:  Unrealistically  precise  sensors 

-Perfect  landmark  detection,  identification,  tracking 

•Exception  -  a  new  sensor  that  provides  a  truly 
revolutionary  capability 

-Sick  laser  rangefinder  that  “cut  the  Gordian  knot”  for  indoor 
mapping 
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Tactical  Mobile  Robotics  (TMR) 
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*DARPA  Advanced  Technologies  Office  (ATO) 
'initiated  by  Dr.  Eric  Krotkov  in  1997 
•Program  Manager  is  LTC  John  Blitch 
•BAA  98-08,  BAA  97-20,  BAA  96-26,  SBIRs,  etc 
•Principai  Agent  is  TACOM-TARDEC 
•SPAWAR  provides  technical  guidance 


-  See  E.  Krotkov  and  J.  Blitch,  “The  DARPA  Tactical  Mobile 
Robotics  Program”,  The  International  Journal  of  Robotics 
Research,  Vol.  18,  No.  7,  July  1999,  pp.  769-776. 
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V  The  Technical  Goal  of  TMR 
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Development  of  a  system  of  robots  capable  of 

operator-tasked  and  -monitored 

perception-based 
autonomous  mobility 

in  diverse  unstructured  environments 

that  can  fit  into  a  rucksack 

and  be  empioyed  in  coordinated  groups 

as  a  tooi  for  the  dismounted  warfighter 
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TMR  Constraints 


Characteristics  necessary  for  a  robot  to  fulfill  the  TMR  role 
Constraints  as  opposed  to  system  deployment  concepts 
Users  will  be  imaginative  in  finding  many  uses  for  TMRs 

Fit  in  a  rucksack  (size,  weight,  compete  with  rations,  ammo,  etc.) 
Climb  upstairs,  downstairs,  clamber  over  rubble 
Maintain  constant  communications  (with  users,  other  TMRs) 
Navigate  based  on  intuitive  operator  direction;  not  get  lost 
Accept  and  require  appropriate  level  of  operator  interaction 

Support  precise  control  when  desired  (e.g.,  blow  mousehole) 
Offer  ZERO  distraction  to  warfighters  in  heat  of  battle 
Don’t  get  in  the  way  or  slow  OPTEMPO 
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TMR  Technology  Wish  List 
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•Well  defined  capabilities 

-  Power  source:  higher  energy  density,  power  density 

-  Processing:  higher  MIPS  per  mass/volume/power 

-  Sensors:  higher  resolution,  range;  lower  size,  weight,  power 

-  Communications  anywhere:  unimpeded  through  matter 
»higher  B/W:  video  ->  color  ->  stereo  ->  omnidirectional 

-  Localization:  equivalent  of  CP-DGPS  anywhere 

•Subtler  capabilities 

-  Locomotion  schemes:  go  anywhere 

-  Perception:  obstacles,  landmarks,  threats,  friends,  etc 
»detect,  classify,  identify,  localize,  track 

-  “Effective  and  efficient”  operator  interface 

-  Sensor-guided  mobility 
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TMR  Phase  I  Core  Performers 
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BAA  98-08  Part  A  Performers  (Technology) 

Mobility:  MIT 
Sensors:  U  Michigan 
Perception:  Yaie,  SRI  Inti 

Autonomy:  SRI  Inti,  CMU,  Stanford,  USC,  Georgia  Tech 

Mission  Packages:  Foster-Miiier 

BAA  98-08  Part  B  Performers  (System  Design) 

SAIC,  Draper  Lab,  Raytheon 

BAA  97-20  Phase  II  Performer  Team 

Jet  Propulsion  Lab  (iead),  CMU  (navigation),  IS  Robotics 
(mobiiity).  Oak  Ridge  Nationai  Lab  (group  behaviors),  USC 
(OCU) 

(pius  SBIR  and  other  anciiiary  participants) 
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If  TMR  Is  So  Hard, 

Why  Do  We  Think  We  Can  Do  it? 


•Moore’s  Law  (processing  availability) 

-  >10**3  gain  beyond  ALV  era 

•Rapid  commercialization  of  relevant  technologies 

-  Wireless  communications 

-  GPS  navigation 

-  Display  technology  and  HDTV 

-  MEMS  and  fiber  optic  based  sensors 

•New  mobility  capabilities  (e.g.,  “Urbie”) 

•Use  of  operator’s  perceptual  capabilities  to  offset 
robot’s  functional/  performance  deficiencies 

-  TMR  autonomy  goals  well-defined,  limited 

-  Flip  side  of  “robot  as  tool” 
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Evolving  Technology  Area: 
Range  Measurement  (1) 

•Used  for  obstacle  avoidance,  mapping 
•Ultrasonic 

-  mature  technology  (1980?),  inexpensive 

-  iow  anguiar  resoiution,  iimited  range 

-  rough  2-D  map  of  nearby  empty  space 

•structured  light 

-  mature  technoiogy,  no  academic  interest,  but  few  if 
any  COTS  subsystems 

-  trianguiation  of  iaser  stripes 

-  active,  iimited  range 

•Laser  line  scanner 

-  Sick  (German)  industriai  unit:  heavy,  expensive 

-  high  anguiar  and  range  resoiution,  ionger  range 

-  precise  2-D  map  of  empty  space 

1  Diego 


Evolving  Technology  Area: 
Range  Measurement  (2) 
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'Stereo  vision 

-  uses  only  cameras  (e.g.,  CMOS)  +  processing  (Moore’s  Law) 

-  3-D  range  map  of  nearby  surfaces  (passive) 

-  needs  visual  texture,  errors  are  1/r**2 

•Scanned  LADAR 

-  expensive,  bulky,  moving  parts 

-  3-D  range  map  of  surfaces  (active) 

-  error  constant  with  range 

•Flash  LADAR 

-  1-5  years  away  (driven  by  auto  market) 

-  range,  resolution  limited  by  laser  power  on  pixel 

-  compact,  inexpensive 


SPAWAR  Systems  Center,  San  Diego 
San  Diego  CA  92152-7383 
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•Acquiring  critical  non-robot-specific 
component  technologies 

-  power,  displays,  communications,  etc 

•Being  small  enough  and  big  enough 

-  Impiementation  fitting  in  rucksack  enveiope 

-  Achieving  functionaiity,  performance 

•Supervised  autonomous  navigation 

-  How  operator  tasks,  monitors,  overrides 

-  How  robots  actuaiiy  execute  moves 

•Implementation:  making  it  all  actually  work 

-  Robotic  system  decomposition/architecture(s) 
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TMR  Evolutionary  Strategy  for 
Achieving  Autonomous  Navigation 


•  Supervised  perception-based  navigation 
commands 

•  Path-referenced  navigational  functions 

•  High-level  misslon-orlented  autonomous  tasks 

-  (Multiple  coordinated  robots) 

-  Mapping  and  monitoring  building  interiors 

-  Adaptive  maintenance  of  communications  connectivity 
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TMR  Supervised  Perception-Based 
Autonomous  Navigation  Capabilities 


*  Goal:  maximize  system  performance  for  the 
availabie  level  of  perception  capability 

•  Build  on  visual  servoing 

*  Add  semantics  of  intent/environment 

-  Analogous  to  indoor  ultrasonic-based  schemes  (e.g.,  wall¬ 
following,  hall-following,  lateral  post  detection)  and  to 
vision-based  road-following 

•  Add  mission  scripting 

•  Add  tools  for  operator  oversight/override 

*  Exploit  future  advances  in  machine  perception 
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Perception-Based 
Navigation  Commands 


•Move  Under  <this>  Vehicle 
•Climb  <how  many>  Flights  Up  <these>  Stairs 
•Climb  <how  many>  Flights  Down  <these>  Stairs 
•Take  <this>  Elevator  to  the  <number>  Floor 
•Cross  <this>  Street  (and  don’t  get  hit) 

•Hide  in  <this>  Vegetation 
•Move  Along  <this>  Wall  (until...) 

•Open  <this>  Door  (and  Enter...  and  Close) 
•Move  in  <this>  Direction  (until...) 

•Wait  until...  (humans  are  (not)  present...) 
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A  Complex  Command  Behavior: 
Using  an  Elevator 

•Take  <this>  elevator  to  the  <number>  Floor 

-  No  people  present  -->  many  people  present 

-  Single  elevator  -->  double  bank  of  elevators 

•Issues 

-  Manipulation:  reach,  strength,  tactiie/haptic  feedback 

-  Sensor  viewpoint  (e.g.,  be  abie  to  see  indicators  above  door) 

-  Perception:  “understand”  controis,  indicators,  auditory  cues 

-  Task  pianning,  execution,  monitoring:  Press  Up  or  Down?  Get 
into  this  eievator?  Press  which  fioor  button?  Get  off  here? 

•A  “good”  challenge 

-  A  usefui  reai  worid  human  task  with  a  good  biend  of  compiexity 
and  structure,  an  easy  tasking  paradigm,  and  ease  of  testing 
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Path-Referenced 
Navigation  Capabiiities 

“Been  There,  Done  That” 

-  Follow  the  leader  (without  interfering) 

-  Route  repiay 

-  Retrotraverse 

-  “Go  back  to  <this>  previous  iocation”  (how  to  specify?) 

Big  operational  payoff 

-  Tasking  in  terms  of  mission  events 

-  Ciassic  “what  do  you  mean  you  can’t...”  stuff 

DGPS  Based  -->  Perception-Based 
System  level  capability,  requires  stored  data 

-  Representation  is  key  --  what  ievei  of  abstraction? 

-  Maximum  ieverage  of  iimited  perception  capabiiities 
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Integration  Flexibility  & 
Tight  Subsystem  Coupling 
Provide  Operationai  Payoffs 


Interoperability* 


Flexibility 


Modularity 


Minimum  size 


Tight  coupling 


Minimum  cost 


Reduced  training 
requirements 


Common  OCU" 


r 

\ 


Simplified 

logistics 


New-technology 
friendly 

Mission  modules 

\ 

Stealth 


Larger  number§^ 
of  robots 


Increased 

operational 

effectiveness 
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Eliminate  Duplication  of 
Sensors  and  Processing 


Subsystem  1 
Sensor  1 


► 


Perception  1 


Output  1 


Subsystem  2 
Sensor  2 


Perception  2 


Action  2 


Output  2 


Subsystem  3 
Sensor  3 


Perception  3 


>  Action  3 


Output  3 
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Eliminate  Duplication  of 
Sensors  and  Processing 
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Eliminate  Duplication  of 
Sensors  and  Processing 


Output  1 


Output  2 


Output  3 
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Defer  Alarm  Thresholding 
to  Improve  Sensor  Fusion 
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Defer  Alarm  Thresholding 
to  Improve  Sensor  Fusion 
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•Building  marketable  robots  requires  both 
inspiration  and  perspiration 

•Computational  Intelligence  is  only  one  piece  of 
the  puzzle 

•While  fuzzy  logic  may  be  good,  fuzzy  thinking  is 
definitely  bad 

•Need  to  achieve  both  architectural  flexibility  and 
lowest  possible  system  cost 

•The  “Holy  Grail”:  vital  research  programs 
principally  funded  by  production  revenue  streams 
(like  ICs  and  solid  state  physics),  building  on  very 
inexpensive  mass-produced  robotic  platforms 
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